Active-Set Identification with Complexity Guarantees of an Almost Cyclic 2-Coordinate Descent Method with Armijo Line Search

نویسندگان

چکیده

This paper establishes finite active-set identification of an almost cyclic 2-coordinate descent method for problems with one linear coupling constraint and simple bounds. First, general results are stated nonconvex objective functions. Then, under convexity a quadratic growth condition (satisfied by any strongly convex function), complexity on the number iterations required to identify active set given. In our analysis, Armijo line search is used compute stepsize, thus not requiring exact minimizations or additional information.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Worst-case Complexity of Cyclic Coordinate Descent: $O(n^2)$ Gap with Randomized Version

This paper concerns the worst-case complexity of Gauss-Seidel method for solving a positive semidefinite linear system; or equivalently, that of cyclic coordinate descent (C-CD) for minimizing a convex quadratic function. The known provable complexity of C-CD can be O(n) times slower than gradient descent (GD) and O(n) times slower than randomized coordinate descent (R-CD). However, these gaps ...

متن کامل

An Infeasible Active Set Method with Combinatorial Line Search for Convex Quadratic Problems with Bound Constraints∗

The minimization of a convex quadratic function under bound constraints is a fundamental building block for solving more complicated optimization problems. The active-set method introduced by Bergounioux et al. [1, 2] has turned out to be a powerful, fast and competitive approach for this problem. Hintermüller et al. [15] provide a theoretical explanation of its efficiency by interpreting it as...

متن کامل

When Cyclic Coordinate Descent Outperforms Randomized Coordinate Descent

Coordinate descent (CD) method is a classical optimization algorithm that has seen a revival of interest because of its competitive performance in machine learning applications. A number of recent papers provided convergence rate estimates for their deterministic (cyclic) and randomized variants that differ in the selection of update coordinates. These estimates suggest randomized coordinate de...

متن کامل

Convergence of Liu-storey Conjugate Method with Nonmonotone Armijo Line Search

In this paper, we develop a new nonmonotone Armijo-type line search for LS (Liu-Storey) conjugate gradient method for minimizing functions having Lipschitz continuous partial derivatives. The nonmonotone line search can guarantee the global convergence of original LS method under some mild conditions. AMS Subject Classification: 90C30, 65K05

متن کامل

Analysis of the Gradient Method with an Armijo-Wolfe Line Search on a Class of Nonsmooth Convex Functions

It has long been known that the gradient (steepest descent) method may fail on nonsmooth problems, but the examples that have appeared in the literature are either devised specifically to defeat a gradient or subgradient method with an exact line search or are unstable with respect to perturbation of the initial point. We give an analysis of the gradient method with steplengths satisfying the A...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Siam Journal on Optimization

سال: 2022

ISSN: ['1095-7189', '1052-6234']

DOI: https://doi.org/10.1137/20m1328014